Further Study on the Convergence Rate of Alternating Direction Method of Multipliers with Logarithmic-quadratic Proximal Regularization
نویسندگان
چکیده
In the literature, the combination of the alternating direction method of multipliers (ADMM) with the logarithmic-quadratic proximal (LQP) regularization has been proved to be convergent and its worst-case convergence rate in the ergodic sense has been established. In this paper, we focus on a convex minimization model and consider an inexact version of the combination of the ADMM with the LQP regularization. Our primary purpose is to further study its convergence rate; and establish its worst-case convergence rates measured by the iteration complexity in both the ergodic and non-ergodic senses. In particular, existing convergence rate results for this combination are subsumed by the new results.
منابع مشابه
An inexact alternating direction method with SQP regularization for the structured variational inequalities
In this paper, we propose an inexact alternating direction method with square quadratic proximal (SQP) regularization for the structured variational inequalities. The predictor is obtained via solving SQP system approximately under significantly relaxed accuracy criterion and the new iterate is computed directly by an explicit formula derived from the original SQP method. Under appropriat...
متن کاملOn the O(1/t) Convergence Rate of Alternating Direction Method with Logarithmic-Quadratic Proximal Regularization
It was recently shown that the alternating direction method with logarithmicquadratic proximal regularization can yield an efficient algorithm for a class of variational inequalities with separable structures. This paper further shows the O(1/t) convergence rate for this kind of algorithms. Both the cases with a simple or general Glowinski’s relaxation factor are discussed.
متن کاملThe convergence rate of the proximal alternating direction method of multipliers with indefinite proximal regularization
The proximal alternating direction method of multipliers (P-ADMM) is an efficient first-order method for solving the separable convex minimization problems. Recently, He et al. have further studied the P-ADMM and relaxed the proximal regularization matrix of its second subproblem to be indefinite. This is especially significant in practical applications since the indefinite proximal matrix can ...
متن کاملLinear Rate Convergence of the Alternating Direction Method of Multipliers for Convex Composite Programming*
In this paper, we aim to prove the linear rate convergence of the alternating direction method of multipliers (ADMM) for solving linearly constrained convex composite optimization problems. Under a mild calmness condition, which holds automatically for convex composite piecewise linear-quadratic programming, we establish the global Q-linear rate of convergence for a general semi-proximal ADMM w...
متن کاملLinearized Alternating Direction Method of Multipliers for Constrained Nonconvex Regularized Optimization
In this paper, we consider a wide class of constrained nonconvex regularized minimization problems, where the constraints are linearly constraints. It was reported in the literature that nonconvex regularization usually yields a solution with more desirable sparse structural properties beyond convex ones. However, it is not easy to obtain the proximal mapping associated with nonconvex regulariz...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- J. Optimization Theory and Applications
دوره 166 شماره
صفحات -
تاریخ انتشار 2015